Research of Emotion Recognition Based on Speech and Facial Expression
نویسندگان
چکیده
The paper introduced the present status of speech emotion recognition. In order to improve the single-mode emotion recognition rate, the bimodal fusion method based on speech and facial expression was proposed. The emotional databases of Chinese speech and facial expressions were established with the noise stimulus and movies evoking subjects' emtion. On the foundation, we analyzed the acoustic features of Chinese speech signals under different emotional states, and obtained the general laws of prosodic feature parameters. We discussed the single-mode speech emotion recognitions based on the prosodic features and the geometric features of facial expression. Then, the bimodal emotion recognition was obtained by the use of Gaussian Mixture Model. The experimental results showed that, the bimodal emotion recognition rate combined with facial expression was about 6% higher than the single-model recognition rate merely using prosodic features.
منابع مشابه
Early Posterior Negativity as Facial Emotion Recognition Index in Children With Attention Deficit Hyperactivity Disorder
Introduction: Studies indicate that children with Attention Deficit Hyperactivity Disorder (ADHD) have deficits in social and emotional functions. It can be hypothesized that these children have some deficits in early stages of facial emotion discrimination. Based on this hypothesis, the present study investigated neural correlates of early visual processing during emotional face recognition in...
متن کاملمقایسه بازشناسی بیان چهرهای هیجان در بیماران مبتلا به افسردگی اساسی و افراد بهنجار
Background : One of the emotional factors involved in major depressive disorder is recognition of facial expression of emotion. The aim of present study was to compare the recognition of facial expression of emotion in patients with major depressive disorder and normal people. Materials and Methods: 20 patients with major depression and 20 normal people were selected using available sampling m...
متن کاملSpeech Emotion Recognition Based on Power Normalized Cepstral Coefficients in Noisy Conditions
Automatic recognition of speech emotional states in noisy conditions has become an important research topic in the emotional speech recognition area, in recent years. This paper considers the recognition of emotional states via speech in real environments. For this task, we employ the power normalized cepstral coefficients (PNCC) in a speech emotion recognition system. We investigate its perfor...
متن کاملFacial Expression Recognition Based on Anatomical Structure of Human Face
Automatic analysis of human facial expressions is one of the challenging problems in machine vision systems. It has many applications in human-computer interactions such as, social signal processing, social robots, deceit detection, interactive video and behavior monitoring. In this paper, we develop a new method for automatic facial expression recognition based on facial muscle anatomy and hum...
متن کاملFacial Expression Recognition Based on Structural Changes in Facial Skin
Facial expressions are the most powerful and direct means of presenting human emotions and feelings and offer a window into a persons’ state of mind. In recent years, the study of facial expression and recognition has gained prominence; as industry and services are keen on expanding on the potential advantages of facial recognition technology. As machine vision and artificial intelligence advan...
متن کامل